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ABSTRACT 

The college- level computer assisted instruction 
(CAI) courses, one in French, the other in Remedial English, were the 
bases for the data presented here* Each CAI course is briefly 
outlines. A summary is then presented of the students* completion 
records and attitude changes* In the case of the Remedial English 
course, it is noted that these records served as feedback in solving 
a programing problem* Data is presented in tabular form at the end of 
the document. (JY) 
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Introduction 

The data we will present are based on two college-level CAI courses, one 
In French, the other in Remedial English. They were offered in cooperation with 
the IBM Company's Thomas J, Watson Research Center near New York City at various 
campuses of the City and State Universities of New York, which formed a CAI net- 
work. What we can present today represents only a small fraction of the data 
collected for evaluation purposes, but my intention is not to report on the evalu- 
ation as such but to illustrate the kinds of data that have been or might be de- 
rived from student records prepared by the computer on the basis of student re- 

t 

sponses to the CAI course materials. 

The French Course 

Instructional Procedures and Assumptions 

In the beginning French course it was intended that CAI should supplement, 
consolidate and reinforce what the instructor taught in class. It was assumed 
that the instructor would follow a fixed lesson sequence and set the pace and 
that the students generally would be expected to "keep up with the class". (In 
college-level foreign language courses there is usually a tacit assumption that 
those who cannot hold the pace will drop out.) The CAI course was closely co- 
ordinated with a textbook; in fact, it was originally prepared by one of the joint 
authors of a leading French textbook for beginners. Dr. Julian Harris, but he did 
not do the computer prop, ramming . Thus the CAI course, and the student manual that 
goes with it, are divided into lessons that exactly correspond with those in the 

I This research was conducted by the Institute for Research in Learning and 
Instruction, under the direction of Dr, Edward D. Lambe. 
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book, but each CAT lesson consists of only three sections (called "units") whereas 
the textbook lessons have several sections. It was intended that the content of 
a CAI lesson should be manageable by an average student in approximately an hour, 
and that students should devote approximately two hours per week to the CAI part 
of the course. In actual use the specific arrangements differed at different cam- 
puses; in some instances CAI sections were excused from one class period per week; 
in others they were excused from assigned homework; in one case the CAI course was, 
at least nominally, additional to the usual requirements of students. 

Student "Computer Communications 

You must realize, of course, that CAI installations are quite diverse. We 
will describe only some of the salient features of the system and equipment used 
in the present instance as they impinge on the individual student. 

At the student terminal material is presented either by electric typewriter or 
by tape recorder with earphones, and the student responds by using the typewriter 
keyboard. A typical response might require from one to 15 or 16 words. The student's 
response--as , for instance, his transcription of dictation heard through the ear- 
phones— is compared with a model stored in the computer memory. The parts of it that 
conform exactly to the model are then retyped by the machine, but parts that do not 
conform are deleted and are replaced by underlining. The student then tries again. 

If his response matches the model on the first try or subsequently the machine types 
"c" for "correct" and proceeds to the next item. If the student fails in several 
attempts, the correct form is typed out by the machine. The computer compares the 
student's successes and failures in each unit with a predetermined standard and 
requires repetition of a unit from the beginn5.ng when the failure rate is too great. 
(Parenthetically, when I say "the machine does thus and so", I should be sayirv 
"the computer programmer does those things", for he is the one who determines the 
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exact details of what the machinery does. I will come back to this point.) 

No alternative sequences of lesson material are provided. In other words, the 
progsram is linear: the sequence of items in a unit is fixed and the svequence of the 

units is fixed. 

Student Performance 

The paper on which the student and the computer (i.e. the programmer) type 
out messages to each other provides a record, of course, of the student’s performance 
and, incidentally of the machine’s performance. These records are voluminous and 
hard to use--you get bushels of paper-~but are very revealing, A summary of part of 
one student’s record, page one of your handout, shows the types of exercises pre- 
sented on certain days, the number of trials this student required in reaching the 
programmer’s standard of satisfactory performance, and some comments typed in by the 
student. An attractive feature of this program was that it invited student comment 
at the end of each unit. 

At the beginning of each CAI session the student’s name, the date and the time 
of day appear on the typescript, which I will call "terminal printout" from now on. 

At the end of the session the time is given, so the duration can be obtained. Page 
two of your handout shows what progress each of five students was making week by 
week over a period of seven weeks at the beginning of the second semester, and how 
much time they were putting in at the CAX terminal, as well as theii average rat^s 
of completion of these units, three of which were supposed to represent a day's les- 
son, We see immediately, on the upper part of the page, that while studvents A and B 
worked rather steadily along other three worked in spurts. Although the un- 
evenness of accomplishment reflects different rates of progress, shown at the bottom 
of the page, it is even more a result of the irregularities in working time. The 

patterns of application document what we may have known about students but have tended 
to ignore- -except occasionally to denounce their erratic behavior and extol absolute 



regularity of study at all times. Student E, who accomplished most in seven weeks, 
was not the fastest student nor was he a steady worker. He just took the bit in his 
teeth and ran through seven lessons in one week against the normal expectation of 
two. This all plays havoc with the assumption that the CAI course is to be closely 
coordinated with the progress of a class, which is imagined to be keeping more or 
less together at a pace set by the instructor. These crude figures, derived from a 
quick analysis of terminal printout, suggest that records of student behavior in CAI 
learning environments should be examined in much more detail. Also, it is obvious 
that the laborious task of abstracting and summarizing from the flow of communications 
the significant information for particular purposes should itself be delegated to the 
computer. A small start has been made in that direction, but from what we have seen 
of several CAI applications, most of this yet remains to be done. 

Now, if you will turn to page three of your handout, you will see the results 
of some rather simple minded computer record-keeping on the French course. On the 
vertical scale we now have number of CAI lessons completed instead of number of units 
and we have a time sptm of 14 weeks not counting a two weeks' break in mid-semester. 
The interesting features here are the relatively steady progress over-all, reflected 
by the medians, the fact that an average of 26 lessons were completed in 14 weeks, 
vindicating the combined judgement of the author and the programmer about the amount 
and difficulty of content to be put into the CAI course, and the familiar pattern of 
divergence between the upper and lower ends of the distributions, further evidence-- 
if any were needed--of the falsity of soDie of the assumptions on which foreign 
language teaching in the seventh decade of the 20th Century still was predicated. 

I want to remind you, before we leave this page, that one should resist the temptation 
to conceptualize the divergence of the set of distributions simply as a representation 
of a family of uniform learning curves differing only in slope. We saw earlier that 
this is not so. 
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Student Attitudes 

Time will not permit us to say much about attitudes toward the French course. 
Despite numerous complaints about particular problems and irritations general at- 
titudes toward the course were surprisingly favorable. Perhaps the students were 
intrigued with the general idea of CAI experimentation. Perhaps they enjoyed mani- 
pulating the machinery. In a survey of student opinion at the end of the first 
semester the question, '’How much benefit do you get from computer-assisted instruction?" 
was asked. The responses were two-to-one for "very much" or "much", as compared with 
"little" or "very little." A similar question applied to language laboratories 
showed overwhelming disapproval not only by CAI students but also by students in regu- 
lar French sections. By a margin of three to one the CAI students indicated that they 
would choose a CAI section again if they were starting French anew and were given a 
choice. By a margin of four to one they said they would recommend this type of CAI 
French course to their friends. One may wonder at this enthusiasm, but it seems to 
have been genuine, at lease at that time. I will not try to explain it further. 

Remedial English 

In describing the Remedial English course I will not go into as much detail as 
we did on the French course. In this case the students had been admitted to the 
City University of New York under a special program called SEEK--Search for Education, 
Elevation and Knowledge— and it was fully anticipated that many or most of them would 
need intensive and extensive remedial instruction in English. The CAI program was 
again designed to supplement and reinforce regular classroom instruction, but was not 
so closely linked to the class^^ork as was the French. It was limited to specific ob- 
jectives in the areas c2 spelling, punctuation and capitalization, and English grammar. 
The student terminals were of the same type as those used in the French course, and 
the general nature of the communication between the student and the computer programmer 
was similar. Unfortunately, the entire experiment was conducted under a severe pressure 
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of time because the computer itself was scheduled to be retired. The course material 
was being developed by Dr. Peter Rosenbaum and was ready for use only barely in time 
for the beginning of the semester. The installation of the equipment at the center 
where the students lived and had their classes was rushed, also. 

From the report on the Remedial English we have chosen to present here only the 
table, on page four of your handout, that corresponds to the table of frequency dis- 
tributions for the French course. Here some 7.ines have been added that represent the 
experimenter’s initial expectations for the group. It is interesting that one fast 
student barely exceeded the anticipated rate of lesson completions. Clearly, however, 
something was wrong with the way the course was working out with average and slow 
members of the group. A degree of sophistication was revealed, however, in that the 
author and programmer were able to take account of the feedback of information from 
the campus and set some of the internal standards more appropriately after the half- 
way point in the course. The rising medians after the 8th week reflect the effects 
of this action. One might be tempted to suppose that the students at the low ends 
of the frequency distributions had effectively dropped out of the CAT course, but in 
reality such was not the case. Except for one or two, they were just plodding slowly 
along. 



Conclusions 

CAI course materials should be tested and revised on the basis of experience in 
use. Why is this not done as a matter of course? Perhaps because they are expensive 
to generate and represent an investment their owners want to protect. Perhaps because 
computer programmers are highly paid and some of them may assume that their own edu- 
cational' judgements are nearly infallible. In a CAI course such judgements seem to have 
a tendency to get locked in unless specific provision is made for revision based on per- 
tinent information. Future experimenters would be well advised to set up data collection 
and analysis procedures within the CAI system by which the program itself could be de- 
veloped and improved. This should include detailed data on student use of time among 
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other things. The basic technology permits far more adaptive applications of CAI 
than we are currently seeing. 
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Summary of Part of One Student*s Record (Abstractsd from Terminal Printout) 



2/14/68 



3/4/68 

3/13/68 



Type of Unit 



Dictation 

Aural comprehension 
Reading comprehension 



2/19/68 Translation 

Substitution-transformation 



2/21/68 Reading comprehension 



Substitution-transformation 
Reading comprehension 



Dictation 

Aural canprehension 



Reading comprehension 
3/25/68 Reading comprehension 



Number of Trials 



h 

1 

3 



1 

1 



1 

6 



1 

1 



h 

5 



Comments 



I would like to be permitted 
more mistaltes before repeating. 



This is a little too easy, 



So close to the end? The 
machine is a sadist? 



This was fun-let's do it again 



For one mistake. Are you for 
reeil? 

It is unfair to make me do 
it over after only one mistake. 
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thuriber of CM Units Completed 



UeeK 



Student 



A 

2 

6 

12 

15 

21 

22 

29 



B 

5 

9 

14 

20 

26 

55 

58 



B 



11 

15 

15 

17 

lyl 

21 

22 






11 

32 

54 
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E 
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1 ^ 


14 


I 8 


14 


i 8 


14 



55 

59 

45 
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V7eek 



Hours per VJeek 



Student 





A 


B 


C 


B 


E 


1 


1.0 


0.8 


1.9 


0.0 


2.0 


2 


2.0 


1.7 


0.6 


1.7 


2.0 


5 


2.3 


1.7 


0.0 


1.7 


0.0 


4 


2.0 


1.6 


0.8 


0.0 


0.0 


5 


1.9 


1.8 


0.0 


1.2 


6.9 


6 


1.0 


1.9 


0.7 


6.4 


1,6 


7 


2.2 


1.0 


0.7 


0.5 


1.6 


Totals 


12?. 4 


10.5 


4.7 


11.5 


14.1 



A 

2.54 



Units per Hour 
Student 

C 



B 

3.62 



4.68 



D 

2.96 



E 

5.05 



Average 



1 
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Frequency Distributions of CM Trench Students at Broo::l:.Ti Collo^-e 

By Iteljer of CAI Lessons Conuleted 

- . - ^ ^ ^ ^ ^ ^ ^ t . 



CAI Lesson Weeks from becinninn of Second Semester 

Completed 



2nd 4th 6th 



8th 



10th 12th l4th 



35 
34 
33 
32 
51 
50 
29 
28 
27 
26 
25 
24 
' 25 
22 
21 
20 
19 
18 
17 
16 
15 
14 
13 
12 
11 
10 

9 

8 

7 

6 

5 

4 

5 
2 
1 
0 



2 

4 
7 

5 

6 

3 



1 

1 

1 

5 

4 

10 

3 

2 

1 

2 

1 

1 



2 

1 

4 
1 
1 

5 
3 

6 

3 

3 



1 

1 



4 

3 

1 

1 

6 

2 

3 

3 

1 

2 

1 

2 



1 

2 

3 

2 

« 



3 

4 

3 

1 

1 

2 

1 

2 

2 

2 



1 

1 

2 

2 

1 

2 

1 

1 

3 

1 

3 

5 

2 

1 



2 



1 



1 

4 

1 

1 

4 



1 

2 

1 

2 

2 

1 

1 

1 

2 

1 

1 

0 

2 

1 



Medians 3 8 11 15 19 22 26 
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k 

' b 5 >’ TTun^ber of CAT Tjossons Cornnleted 



CAI Lesson 

CoiTipleted V7eeks frorr. Beginning of First Semester 



2nd _ 4th 6th 8th 



10th 



12th 




Target for 
slow students 



Medians 1.2 3.2 4.0 



5.5 



18.5 26.0 

- 




